3D magnetic seed localization for augmented reality in surgery.

PURPOSE: For tumor resection, surgeons need to localize the tumor. For this purpose, a magnetic seed can be inserted into the tumor by a radiologist and, during surgery, a magnetic detection probe informs the distance to the seed for localization. In this case, the surgeon still needs to mentally reconstruct the position of the tumor from the probe's information. The purpose of this study is to develop and assess a method for 3D localization and visualization of the seed, facilitating the localization of the tumor. METHODS: We propose a method for 3D localization of the magnetic seed by extending the magnetic detection probe with a tracking-based localization. We attach a position sensor (QR-code or optical marker) to the probe in order to track its 3D pose (respectively, using a head-mounted display with a camera or optical tracker). Following an acquisition protocol, the 3D probe tip and seed position are subsequently obtained by solving a system of equations based on the distances and the 3D probe poses. RESULTS: The method was evaluated with an optical tracking system. An experimental setup using QR-code tracking (resp. using an optical marker) achieves an average of 1.6 mm (resp. 0.8 mm) 3D distance between the localized seed and the ground truth. Using a breast phantom setup, the average 3D distance is 4.7 mm with a QR-code and 2.1 mm with an optical marker. CONCLUSION: Tracking the magnetic detection probe allows 3D localization of a magnetic seed, which opens doors for augmented reality target visualization during surgery. Such an approach should enhance the perception of the localized region of interest during the intervention, especially for breast tumor resection where magnetic seeds can already be used in the protocol.

Automated image registration of cerebral digital subtraction angiography.

PURPOSE: Our aim is to automatically align digital subtraction angiography (DSA) series, recorded before and after endovascular thrombectomy. Such alignment may enable quantification of procedural success. METHODS: Firstly, we examine the inherent limitations for image registration, caused by the projective characteristics of DSA imaging, in a representative set of image pairs from thrombectomy procedures. Secondly, we develop and assess various image registration methods (SIFT, ORB). We assess these methods using manually annotated point correspondences for thrombectomy image pairs. RESULTS: Linear transformations that account for scale differences are effective in aligning DSA sequences. Two anatomical landmarks can be reliably identified for registration using a U-net. Point-based registration using SIFT and ORB proves to be most effective for DSA registration and are applicable to recordings for all patient sub-types. Image-based techniques are less effective and did not refine the results of the best point-based registration method. CONCLUSION: We developed and assessed an automated image registration approach for cerebral DSA sequences, recorded before and after endovascular thrombectomy. Accurate results were obtained for approximately 85% of our image pairs.

Retinal OCT speckle as a biomarker for glaucoma diagnosis and staging.

This paper presents a novel image analysis strategy that increases the potential of macular Optical Coherence Tomography (OCT) by using speckle features as biomarkers in different stages of glaucoma. A large pool of features (480) were computed for a subset of macular OCT volumes of the Leuven eye study cohort. The dataset contained 258 subjects that were divided into four groups based on their glaucoma severity: Healthy (56), Mild (94), Moderate (48), and Severe (60). The OCT speckle features were categorized as statistical properties, statistical distributions, contrast, spatial gray-level dependence matrices, and frequency domain features. The averaged thicknesses of ten retinal layers were also collected. Kruskal-Wallis H test and multivariable regression models were used to infer the most significant features related to glaucoma severity classification and to the correlation with visual field mean deviation. Four features were selected as being the most relevant: the ganglion cell layer (GCL) and the inner plexiform layer (IPL) thicknesses, and two OCT speckle features, the data skewness computed on the retinal nerve fiber layer (RNFL) and the scale parameter (a) of the generalized gamma distribution fitted to the GCL data. Based on a significance level of 0.05, the regression models revealed that RNFL skewness exhibited the highest significance among the features considered for glaucoma severity staging (p-values of 8.6×10-6 for the logistic model and 2.8×10-7 for the linear model). Furthermore, it demonstrated a strong negative correlation with the visual field mean deviation (ρ=-0.64). The post hoc analysis revealed that, when distinguishing healthy controls from glaucoma subjects, GCL thickness is the most relevant feature (p-value of 8.7×10-5). Conversely, when comparing the Mild versus Moderate stages of glaucoma, RNFL skewness emerged as the only feature exhibiting statistical significance (p-value = 0.001). This work shows that macular OCT speckle contains information that is currently not used in clinical practice, and not only complements structural measurements (thickness) but also has a potential for glaucoma staging.

Towards quantitative digital subtraction perfusion angiography: An animal study.

BACKGROUND: X-ray digital subtraction angiography (DSA) is the imaging modality for peri-procedural guidance and treatment evaluation in (neuro-) vascular interventions. Perfusion image construction from DSA, as a means of quantitatively depicting cerebral hemodynamics, has been shown feasible. However, the quantitative property of perfusion DSA has not been well studied. PURPOSE: To comparatively study the independence of deconvolution-based perfusion DSA with respect to varying injection protocols, as well as its sensitivity to alterations in brain conditions. METHODS: We developed a deconvolution-based algorithm to compute perfusion parametric images from DSA, including cerebral blood volume (CBV D S A $_{DSA}$ ), cerebral blood flow (CBF D S A $_{DSA}$ ), time to maximum (Tmax), and mean transit time (MTT D S A $_{DSA}$ ) and applied it to DSA sequences obtained from two swine models. We also extracted the time intensity curve (TIC)-derived parameters, that is, area under the curve (AUC), peak concentration of the curve, and the time to peak (TTP) from these sequences. Deconvolution-based parameters were quantitatively compared to TIC-derived parameters in terms of consistency upon variations in injection profile and time resolution of DSA, as well as sensitivity to alterations of cerebral condition. RESULTS: Comparing to TIC-derived parameters, the standard deviation (SD) of deconvolution-based parameters (normalized with respect to the mean) are two to five times smaller, indicating that they are more consistent across different injection protocols and time resolutions. Upon ischemic stroke induced in a swine model, the sensitivities of deconvolution-based parameters are equal to, if not higher than, those of TIC-derived parameters. CONCLUSIONS: In comparison to TIC-derived parameters, deconvolution-based perfusion imaging in DSA shows significantly higher quantitative reliability against variations in injection protocols across different time resolutions, and is sensitive to alterations in cerebral hemodynamics. The quantitative nature of perfusion angiography may allow for objective treatment assessment in neurovascular interventions.

Optimized preoperative planning of double outlet right ventricle patients by 3D printing and virtual reality: a pilot study.

OBJECTIVES: In complex double outlet right ventricle (DORV) patients, the optimal surgical approach may be difficult to assess based on conventional 2-dimensional (2D) ultrasound (US) and computed tomography (CT) imaging. The aim of this study is to assess the added value of 3-dimensional (3D) printed and 3D virtual reality (3D-VR) models of the heart used for surgical planning in DORV patients, supplementary to the gold standard 2D imaging modalities. METHODS: Five patients with different DORV subtypes and high-quality CT scans were selected retrospectively. 3D prints and 3D-VR models were created. Twelve congenital cardiac surgeons and paediatric cardiologists, from 3 different hospitals, were shown 2D-CT first, after which they assessed the 3D print and 3D-VR models in random order. After each imaging method, a questionnaire was filled in on the visibility of essential structures and the surgical plan. RESULTS: Spatial relationships were generally better visualized using 3D methods (3D printing/3D-VR) than in 2D. The feasibility of ventricular septum defect patch closure could be determined best using 3D-VR reconstructions (3D-VR 92%, 3D print 66% and US/CT 46%, P < 0.01). The percentage of proposed surgical plans corresponding to the performed surgical approach was 66% for plans based on US/CT, 78% for plans based on 3D printing and 80% for plans based on 3D-VR visualization. CONCLUSIONS: This study shows that both 3D printing and 3D-VR have additional value for cardiac surgeons and cardiologists over 2D imaging, because of better visualization of spatial relationships. As a result, the proposed surgical plans based on the 3D visualizations matched the actual performed surgery to a greater extent.

Epicardial fat volume is related to the degree of cardiac allograft vasculopathy.

OBJECTIVES: Increasing evidence suggests a role for epicardial fat in the development of coronary artery disease in the general population. Heart transplantation patients are at increased risk of developing a specific form of coronary artery disease, cardiac allograft vasculopathy (CAV), which has far-reaching consequences in terms of morbidity and mortality. Until now, the role of epicardial fat volume (EFV) in the development of CAV remains unknown. Hence, we investigated the relationship between EFV and CAV as well as the influence of donor/recipient sex on EFV. METHODS: Adult heart transplant patients who underwent coronary computed tomography angiography (CCTA) for CAV screening who were four or more years post-HT were included. Using the CT examinations, we quantified the EFV and the degree of CAV. Ordinal and linear regression models were used to assess the association of EFV with CAV. RESULTS: In total, 149 (median age 44.5 years, 36% women) patients were included. The median time between HT and the CT scan was 11.0 (7.3-16.1) years. CAV grade 0, 1, 2 and 3 were seen in 85 (57%), 32 (22%), 14 (9%), and 18 (12%) patients, respectively. The median EFV was 208.4 (128.9-276.0) mL. Larger EFV were related to higher degrees of CAV (median of 164.7 to 290.6 mL for CAV grade 0 and 3, respectively, OR 5.23 (2.47-11.06), p < 0.001). Male recipients had significantly more EFV than female recipients irrespective of the donor sex (232.7 mL vs. 147.2 mL respectively, p < 0.001). Determinants for EFV were recipient sex, number of rejections, donor age, time between HT and CT scan, recipient BMI, and diabetes mellitus. CONCLUSIONS: EFV was associated with higher degrees of CAV. The recipient sex influenced the EFV more than the donor sex. KEY POINTS: • Patients after heart transplantation have a high amount of epicardial fat while larger amounts of epicardial fat are related to higher grades of cardiac allograft vasculopathy. • Determinants of higher epicardial fat volume included recipient sex, number of rejections, donor age, time between HT and CT scan, recipient BMI, and diabetes mellitus. • Longitudinal studies are needed to further disentangle the role of epicardial fat in the development and progression of cardiac allograft vasculopathy. Demonstration of four patients (from CAV grade 0 to CAV grade 3) in whom epicardial fat volume was determined. In red, the voxels identified as epicardial fat.

Time dependency of automated collateral scores in computed tomography angiography and computed tomography perfusion images in patients with intracranial arterial occlusion.

PURPOSE: The assessment of collateral status may depend on the timing of image acquisition. The purpose of this study is to investigate whether there are optimal time points in CT Perfusion (CTP) for collateral status assessment, and compare collaterals scores at these time points with collateral scores from multiphase CT angiography (mCTA). METHODS: Patients with an acute intracranial occlusion who underwent baseline non-contrast CT, mCTA and CT perfusion were selected. Collateral status was assessed using an automatically computed Collateral Ratio (CR) score in mCTA, and predefined time points in CTP acquisition. CRs extracted from CTP were correlated with CRs from mCTA. In addition, all CRs were related to baseline National Institutes of Health Stroke Scale (NIHSS) and Alberta Stoke Program Early CT Score (ASPECTS) with linear regression analysis to find the optimal CR. RESULTS: In total 58 subjects (median age 74 years; interquartile range 61-83 years; 33 male) were included. When comparing the CRs from the CTP vs. mCTA acquisition, the strongest correlations were found between CR from baseline mCTA and the CR at the maximal intensity projection of time-resolved CTP (r = 0.81) and the CR at the peak of arterial enhancement point (r = 0.78). Baseline mCTA-derived CR had the highest correlation with ASPECTS (ß = 0.36 (95%CI 0.11, 0.61)) and NIHSS (ß = - 0.48 (95%CI - 0.72, - 0.16)). CONCLUSION: Collateral status assessment strongly depends on the timing of acquisition. Collateral scores obtained from mCTA imaging is close to the optimal collateral score obtained from CTP imaging.

Deep reinforcement learning for cerebral anterior vessel tree extraction from 3D CTA images.

Extracting the cerebral anterior vessel tree of patients with an intracranial large vessel occlusion (LVO) is relevant to investigate potential biomarkers that can contribute to treatment decision making. The purpose of our work is to develop a method that can achieve this from routinely acquired computed tomography angiography (CTA) and computed tomography perfusion (CTP) images. To this end, we regard the anterior vessel tree as a set of bifurcations and connected centerlines. The method consists of a proximal policy optimization (PPO) based deep reinforcement learning (DRL) approach for tracking centerlines, a convolutional neural network based bifurcation detector, and a breadth-first vessel tree construction approach taking the tracking and bifurcation detection results as input. We experimentally determine the added values of various components of the tracker. Both DRL vessel tracking and CNN bifurcation detection were assessed in a cross validation experiment using 115 subjects. The anterior vessel tree formation was evaluated on an independent test set of 25 subjects, and compared to interobserver variation on a small subset of images. The DRL tracking result achieves a median overlapping rate until the first error (1.8 mm off the reference standard) of 100, [46, 100] % on 8032 vessels over 115 subjects. The bifurcation detector reaches an average recall and precision of 76% and 87% respectively during the vessel tree formation process. The final vessel tree formation achieves a median recall of 68% and precision of 70%, which is in line with the interobserver agreement.

Siamese model for collateral score prediction from computed tomography angiography images in acute ischemic stroke.

Introduction: Imaging biomarkers, such as the collateral score as determined from Computed Tomography Angiography (CTA) images, play a role in treatment decision making for acute stroke patients. In this manuscript, we present an end-to-end learning approach for automatic determination of a collateral score from a CTA image. Our aim was to investigate whether such end-to-end learning approaches can be used for this classification task, and whether the resulting classification can be used in existing outcome prediction models. Methods: The method consists of a preprocessing step, where the CTA image is aligned to an atlas and divided in the two hemispheres: the affected side and the healthy side. Subsequently, a VoxResNet based convolutional neural network is used to extract features at various resolutions from the input images. This is done by using a Siamese model, such that the classification is driven by the comparison between the affected and healthy using a unique set of features for both hemispheres. After masking the resulting features for both sides with the vascular region and global average pooling (per hemisphere) and concatenation of the resulting features, a fully connected layer is used to determine the categorized collateral score. Experiments: Several experiments have been performed to optimize the model hyperparameters and training procedure, and to validate the final model performance. The hyperparameter optimization and subsequent model training was done using CTA images from the MR CLEAN Registry, a Dutch multi-center multi-vendor registry of acute stroke patients that underwent endovascular treatment. A separate set of images, from the MR CLEAN Trial, served as an external validation set, where collateral scoring was assessed and compared with both human observers and a recent more traditional model. In addition, the automated collateral scores have been used in an existing functional outcome prediction model that uses both imaging and non-imaging clinical parameters. Conclusion: The results show that end-to-end learning of collateral scoring in CTA images is feasible, and does perform similar to more traditional methods, and the performance also is within the inter-observer variation. Furthermore, the results demonstrate that the end-to-end classification results also can be used in an existing functional outcome prediction model.

Multi-modal and multi-scale clinical retinal imaging system with pupil and retinal tracking.

We present a compact multi-modal and multi-scale retinal imaging instrument with an angiographic functional extension for clinical use. The system integrates scanning laser ophthalmoscopy (SLO), optical coherence tomography (OCT) and OCT angiography (OCTA) imaging modalities and provides multi-scale fields of view. For high resolution, and high lateral resolution in particular, cellular imaging correction of aberrations by adaptive optics (AO) is employed. The entire instrument has a compact design and the scanning head is mounted on motorized translation stages that enable 3D self-alignment with respect to the subject's eye by tracking the pupil position. Retinal tracking, based on the information provided by SLO, is incorporated in the instrument to compensate for retinal motion during OCT imaging. The imaging capabilities of the multi-modal and multi-scale instrument were tested by imaging healthy volunteers and patients.

Augmented reality navigation for minimally invasive craniosynostosis surgery: a phantom study.

PURPOSE: In minimally invasive spring-assisted craniectomy, surgeons plan the surgery by manually locating the cranial sutures. However, this approach is prone to error. Augmented reality (AR) could be used to visualize the cranial sutures and assist in the surgery planning. The purpose of our work is to develop an AR-based system to visualize cranial sutures, and to assess the accuracy and usability of using AR-based navigation for surgical guidance in minimally invasive spring-assisted craniectomy. METHODS: An AR system was developed that consists of an electromagnetic tracking system linked with a Microsoft HoloLens. The system was used to conduct a study with two skull phantoms. For each phantom, five sutures were annotated and visualized on the skull surface. Twelve participants assessed the system. For each participant, model alignment using six anatomical landmarks was performed, followed by the participant delineation of the visualized sutures. At the end, the participants filled a system usability scale (SUS) questionnaire. For evaluation, an independent optical tracking system was used and the delineated sutures were digitized and compared to the CT-annotated sutures. RESULTS: For a total of 120 delineated sutures, the distance of the annotated sutures to the planning reference was [Formula: see text] mm. The average delineation time per suture was [Formula: see text] s. For the system usability questionnaire, an average SUS score of 73 was obtained. CONCLUSION: The developed AR-system has good accuracy (average 2.4 mm distance) and could be used in the OR. The system can assist in the pre-planning of minimally invasive craniosynostosis surgeries to locate cranial sutures accurately instead of the traditional approach of manual palpation. Although the conducted phantom study was designed to closely reflect the clinical setup in the OR, further clinical validation of the developed system is needed and will be addressed in a future work.

Inter-rater reliability for assessing intracranial collaterals in patients with acute ischemic stroke: comparing 29 raters and an artificial intelligence-based software.

PURPOSE: Outcome of endovascular treatment in acute ischemic stroke patients is depending on the collateral circulation maintaining blood flow to the ischemic territory. We evaluated the inter-rater reliability and accuracy of raters and an automated algorithm for assessing the collateral score (CS, range: 0-3) in acute ischemic stroke patients. METHODS: Baseline CTA scans with an intracranial anterior occlusion from the MR CLEAN study (n=500) were used. For each core lab CS, ten CTA scans with sufficient quality were randomly selected. After a training session in collateral scoring, all selected CTA scans were individually evaluated for a visual CS by three groups: 7 radiologists, 13 junior and 9 senior radiology residents. Two additional radiologists scored CS to be used as reference, with a third providing a CS to produce a 2 out of 3 consensus CS in case of disagreement. An automated algorithm was also used to compute CS. Inter-rater agreement was reported with intraclass correlation coefficient (ICC). Accuracy of visual and automated CS were calculated. RESULTS: 39 CTA scans were assessed (1 corrupt CTA-scan excluded). All groups showed a moderate ICC (0.689-0.780) in comparison to the reference standard. Overall human accuracy was 65± 7% and increased to 88± 5% for dichotomized CS (0-1, 2-3). Automated CS accuracy was 62%, and 90% for dichotomized CS. No significant difference in accuracy was found between groups with different levels of expertise. CONCLUSION: After training, inter-rater reliability in collateral scoring was not influenced by experience. Automated CS performs similar to residents and radiologists in determining a collateral score.

Automatic Segmentation of the Optic Nerve Head Region in Optical Coherence Tomography: A Methodological Review.

The optic nerve head (ONH) represents the intraocular section of the optic nerve, which is prone to damage by intraocular pressure (IOP). The advent of optical coherence tomography (OCT) has enabled the evaluation of novel ONH parameters, namely the depth and curvature of the lamina cribrosa (LC). Together with the Bruch's membrane minimum-rim-width (BMO-MRW), these seem to be promising ONH parameters for diagnosis and monitoring of retinal diseases such as glaucoma. Nonetheless, these OCT derived biomarkers are mostly extracted through manual segmentation, which is time-consuming and prone to bias, thus limiting their usability in clinical practice. The automatic segmentation of ONH in OCT scans could further improve the current clinical management of glaucoma and other diseases. This review summarizes the current state-of-the-art in automatic segmentation of the ONH in OCT. PubMed and Scopus were used to perform a systematic review. Additional works from other databases (IEEE, Google Scholar and ARVO IOVS) were also included, resulting in a total of 29 reviewed studies. For each algorithm, the methods, the size and type of dataset used for validation, and the respective results were carefully analysed. The results show a lack of consensus regarding the definition of segmented regions, extracted parameters and validation approaches, highlighting the importance and need of standardized methodologies for ONH segmentation. Only with a concrete set of guidelines, these automatic segmentation algorithms will build trust in data-driven segmentation models and be able to enter clinical practice.

Signal-carrying speckle in optical coherence tomography: a methodological review on biomedical applications.

SIGNIFICANCE: Speckle has historically been considered a source of noise in coherent light imaging. However, a number of works in optical coherence tomography (OCT) imaging have shown that speckle patterns may contain relevant information regarding subresolution and structural properties of the tissues from which it is originated. AIM: The objective of this work is to provide a comprehensive overview of the methods developed for retrieving speckle information in biomedical OCT applications. APPROACH: PubMed and Scopus databases were used to perform a systematic review on studies published until December 9, 2021. From 146 screened studies, 40 were eligible for this review. RESULTS: The studies were clustered according to the nature of their analysis, namely static or dynamic, and all features were described and analyzed. The results show that features retrieved from speckle can be used successfully in different applications, such as classification and segmentation. However, the results also show that speckle analysis is highly application-dependant, and the best approach varies between applications. CONCLUSIONS: Several of the reviewed analyses were only performed in a theoretical context or using phantoms, showing that signal-carrying speckle analysis in OCT imaging is still in its early stage, and further work is needed to validate its applicability and reproducibility in a clinical context.

Diagnostic performance of an algorithm for automated collateral scoring on computed tomography angiography.

OBJECTIVES: Outcome of endovascular treatment in acute ischemic stroke patients depends on collateral circulation to provide blood supply to the ischemic territory. We evaluated the performance of a commercially available algorithm for assessing the collateral score (CS) in acute ischemic stroke patients. METHODS: Retrospectively, baseline CTA scans (≤ 3-mm slice thickness) with an intracranial carotid artery (ICA), middle cerebral artery segment M1 or M2 occlusion, from the MR CLEAN Registry (n = 1627) were evaluated. All CTA scans were evaluated for visual CS (0-3) by eight expert radiologists (reference standard). A Web-based AI algorithm quantified the collateral circulation (0-100%) for correctly detected occlusion sides. Agreement between visual CS and categorized automated CS (0: 0%, 1: > 0- ≤ 50%, 2: > 50- < 100%, 3: 100%) was assessed. Area under the curve (AUC) values for classifying patients in having good (CS: 2-3) versus poor (CS: 0-1) collaterals and for predicting functional independence (90-day modified Rankin Scale 0-2) were computed. Influence of CTA acquisition timing after contrast material administration was reported. RESULTS: In the analyzed scans (n = 1024), 59% agreement was found between visual CS and automated CS. An AUC of 0.87 (95% CI: 0.85-0.90) was found for discriminating good versus poor CS. Timing of CTA acquisition did not influence discriminatory performance. AUC for predicting functional independence was 0.66 (95% CI 0.62-0.69) for automated CS, similar to visual CS 0.64 (95% CI 0.61-0.68). CONCLUSIONS: The automated CS performs similar to radiologists in determining a good versus poor collateral score and predicting functional independence in acute ischemic stroke patients with a large vessel occlusion. KEY POINTS: • Software for automated quantification of intracerebral collateral circulation on computed tomography angiography performs similar to expert radiologists in determining a good versus poor collateral score. • Software for automated quantification of intracerebral collateral circulation on computed tomography angiography performs similar to expert radiologists in predicting functional independence in acute ischemic stroke patients with a large vessel occlusion. • The timing of computed tomography angiography acquisition after contrast material administration did not influence the performance of automated quantification of the collateral status.

Spatio-temporal deep learning for automatic detection of intracranial vessel perforation in digital subtraction angiography during endovascular thrombectomy.

Intracranial vessel perforation is a peri-procedural complication during endovascular therapy (EVT). Prompt recognition is important as its occurrence is strongly associated with unfavorable treatment outcomes. However, perforations can be hard to detect because they are rare, can be subtle, and the interventionalist is working under time pressure and focused on treatment of vessel occlusions. Automatic detection holds potential to improve rapid identification of intracranial vessel perforation. In this work, we present the first study on automated perforation detection and localization on X-ray digital subtraction angiography (DSA) image series. We adapt several state-of-the-art single-frame detectors and further propose temporal modules to learn the progressive dynamics of contrast extravasation. Application-tailored loss function and post-processing techniques are designed. We train and validate various automated methods using two national multi-center datasets (i.e., MR CLEAN Registry and MR CLEAN-NoIV Trial), and one international multi-trial dataset (i.e., the HERMES collaboration). With ten-fold cross-validation, the proposed methods achieve an area under the curve (AUC) of the receiver operating characteristic of 0.93 in terms of series level perforation classification. Perforation localization precision and recall reach 0.83 and 0.70 respectively. Furthermore, we demonstrate that the proposed automatic solutions perform at similar level as an expert radiologist.

Adaptive optics ophthalmoscopy: a systematic review of vascular biomarkers.

Retinal vascular diseases are a leading cause for blindness and partial sight certifications. By applying adaptive optics (AO) to conventional imaging modalities, the microstructures of the retinal vasculature can be observed with high spatial resolution, hence offering a unique opportunity for the exploration of the human microcirculation. The objective of this systematic review is to describe the current state of retinal vascular biomarkers imaged by AO flood illumination ophthalmoscopy (FIO) and AO scanning laser ophthalmoscopy (SLO). A literature research was conducted in the PubMed and Scopus databases on July 9, 2020. From 217 screened studies, 42 were eligible for this review. All studies underwent a quality check regarding their content. A meta-analysis was performed for the biomarkers reported for the same pathology in at least three studies using the same modality. The most frequently studied vascular biomarkers were the inner diameter (ID), outer diameter (OD), parietal thickness (PT), wall cross-sectional area (WCSA), and wall-to-lumen ratio (WLR). The applicability of AO vascular biomarkers has been mostly explored in systemic hypertension using AO FIO and in diabetes using AO SLO. The result of the meta-analysis for hypertensive patients showed that WLR, PT, and ID were significantly different when compared to healthy controls, while WCSA was not (P < 0.001, P = 0.002, P < 0.001, and P = 0.070, respectively). The presented review shows that, although a substantial number of retinal vascular biomarkers have been explored in AO en face imaging, further clinical research and standardization of procedures is needed to validate such biomarkers for the longitudinal monitoring of arterial hypertension and other diseases.

Block-matching-based registration to evaluate ultrasound visibility of percutaneous needles in liver-mimicking phantoms.

PURPOSE: To present a novel methodical approach to compare visibility of percutaneous needles in ultrasound images. METHODS: A motor-driven rotation platform was used to gradually change the needle angle while capturing image data. Data analysis was automated using block-matching-based registration, with a tracking and refinement step. Every 25 frames, a Hough transform was used to improve needle alignments after large rotations. The method was demonstrated by comparing three commercial needles (14G radiofrequency ablation, RFA; 18G Trocar; 22G Chiba) and six prototype needles with different sizes, materials, and surface conditions (polished, sand-blasted, and kerfed), within polyvinyl alcohol phantom tissue and ex vivo bovine liver models. For each needle and angle, a contrast-to-noise ratio (CNR) was determined to quantify visibility. CNR values are presented as a function of needle type and insertion angle. In addition, the normalized area under the (CNR-angle) curve was used as a summary metric to compare needles. RESULTS: In phantom tissue, the first kerfed needle design had the largest normalized area of visibility and the polished 1 mm diameter stainless steel needle the smallest (0.704 ± 0.199 vs. 0.154 ± 0.027, p < 0.01). In the ex vivo model, the second kerfed needle design had the largest normalized area of visibility, and the sand-blasted stainless steel needle the smallest (0.470 ± 0.190 vs. 0.127 ± 0.047, p < 0.001). As expected, the analysis showed needle visibility peaks at orthogonal insertion angles. For acute or obtuse angles, needle visibility was similar or reduced. Overall, the variability in needle visibility was considerably higher in livers. CONCLUSION: The best overall visibility was found with kerfed needles and the commercial RFA needle. The presented methodical approach to quantify ultrasound visibility allows comparisons of (echogenic) needles, as well as other technological innovations aiming to improve ultrasound visibility of percutaneous needles, such as coatings, material treatments, and beam steering approaches.

Virtual extensions improve perception-based instrument alignment using optical see-through devices.

Instrument alignment is a common task in various surgical interventions using navigation. The goal of the task is to position and orient an instrument as it has been planned preoperatively. To this end, surgeons rely on patient-specific data visualized on screens alongside preplanned trajectories. The purpose of this manuscript is to investigate the effect of instrument visualization/non visualization on alignment tasks, and to compare it with virtual extensions approach which augments the realistic representation of the instrument with simple 3D objects. 18 volunteers performed six alignment tasks under each of the following conditions: no visualization on the instrument; realistic visualization of the instrument; realistic visualization extended with virtual elements (Virtual extensions). The first condition represents an egocentric-based alignment while the two other conditions additionally make use of exocentric depth estimation to perform the alignment. The device used was a see-through device (Microsoft HoloLens 2). The positions of the head and the instrument were acquired during the experiment. Additionally, the users were asked to fill NASA-TLX and SUS forms for each condition. The results show that instrument visualization is essential for a good alignment using see-through devices. Moreover, virtual extensions helped achieve the best performance compared to the other conditions with medians of 2 mm and 2° positional and angular error respectively. Furthermore, the virtual extensions decreased the average head velocity while similarly reducing the frustration levels. Therefore, making use of virtual extensions could facilitate alignment tasks in augmented and virtual reality (AR/VR) environments, specifically in AR navigated surgical procedures when using optical see-through devices.